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Abstract 


The  Pro-Active  Intelligence  (PAINT)  program,  sponsored  by  the  Intelligence  Advanced 
Research  Projects  Activity  (I  ARP  A),  was  formed  to  address  the  challenges^  posed  by 
distributed  human  networks,  including  terrorists  and  insurgencies,  both  independent  and 
state-sponsored.  In  particular,  certain  threats  (including  emerging  dual-use  technologies) 
are  difficult  to  detect  using  traditional  intelligence  means  because:  (a)  indicators  are 
difficult  to  discern  and  may  give  little  warning  time,  (b)  there  is  usually  limited  relevant 
data  collection  and  integration  capability,  and  (c)  expertise  is  generally  diverse  and 
disconnected. 

Over  the  course  of  18  months  from  September  2007  to  February  2009,  an  effort,  led  by 
researchers  from  MIT,  was  initiated  to  develop  computational  social  science  models  to 
study  and  understand  the  dynamics  of  complex  intelligence  targets  for  nefarious 
technology  activities  (broadly  defined  as  activities  outside  U.S.  national  interest).  System 
dynamics  models  were  developed  because  they  offered  great  opportunities  to  (a) 
understand  and  represent  determinants  of  nefarious  technology  development,  (b)  to 
identify  aspects  of  critical  pathways,  such  as  resource  management,  towards  the 
development  of  nefarious  technologies,  and  (c)  support  a  modeling  based  strategy  for  the 
identification  of  new  sources  of  intelligence. 

This  report  describes  the  “System  Dynamics  Modeling  for  Pro-Active  Intelligence”  effort 
and  its  two  thrusts:  (a)  development  of  a  comprehensive  holistic  system  dynamics  model 
to  represent,  understand,  and  differentiate  nefarious  and  benign  activities  and  (b)  the 
development  of  a  detailed  system  dynamics  resource  model  that  can  be  used  as  a 
component  of  a  multi-method  federation  of  models.  In  both  cases,  simulations  were 
conducted  to  illustrate  the  effectiveness  of  these  models  in  demonstrating  system 
behavior  and,  on  occasion,  highlighting  potentially  counter-intuitive  behaviors. 


'  From  http://www.icahst.org/docs/20Q7-10-Q3/Bush%2QIARPA%20BrieP/o200ct%2020Q7.pdf 
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1. Introduction 

Emerging  technology  activities  in  various  parts  of  the  world  are  a  source  of  threat  to  U.S. 
national  security.  In  particular,  certain  threats  (including  emerging  dual-use 
technologies,  such  as  nanotechnology)  are  difficult  to  detect  using  traditional  means.  In 
its  introduction,  the  Report  of  the  Joint  Defense  Science  Board  Intelligence  Science 
Board  Task  Force  on  Integrating  Sensor-Collected  Intelligence  states:  ''The  evolving 
international  security  landscape  has  become  much  more  complicated,  diverse,  distributed 
and  challenging...  This  evolving  landscape  presents  many  [intelligence,  surveillance,  and 
reconnaissance]  ISR  challenges.  ”  [Office  of  the  Under  Secretary  of  Defense  for 
Acquisitions,  Technology,  and  Logistics,  2008]  While  every  case  is  unique,  there  are 
common  processes  tending  toward  threat  development  which  can  help  point  to  new 
sources  of  intelligence  information.  Given  current  realities  and  uncertainties,  “better 
operational  preparedness”  can  be  achieved  by  identifying,  controlling  and  managing  the 
linkages  and  situational  factors  that  can  promote  the  development  and  use  of  emerging 
technologies. 

Over  the  course  of  18  months  from  September  2007  to  February  2009,  an  effort,  led  by 
researchers  from  MIT,  worked  with  lARPA^ — as  part  of  the  Pro-Active  Intelligence 
(PAINT)  program — to  develop  computational  social  science  models  to  study  and 
understand  the  dynamics  of  complex  intelligence  targets  for  nefarious  technology 
activities  (broadly  defined  as  activities  outside  U.S.  national  interest).  The  MIT  team 
developed  system  dynamics  models^  to  (a)  understand  and  represent  determinants  of 
nefarious  technology  development,  (b)  to  identify  aspects  of  critical  pathways,  such  as 
resource  management,  towards  the  development  of  nefarious  technologies,  and  (c) 
support  a  modeling  based  strategy  for  the  identification  of  new  sources  of  intelligence. 

In  this  report,  we  review  the  way  in  which  we  have  modeled  the  context  surrounding  the 
development  of  nefarious  technologies.  More  specifically,  we  articulate  a  modeling  based 
strategy  to  utilize  system  dynamics  in  the  targeting  and  collection  of  active  intelligence, 
defined  as  “an  action  or  stimulus  designed  to  produce  system  behaviors  (active  probe)  or 
to  collect  data  (passive  probe)  that  allow  analysts  to  distinguish  the  existence  of  a  specific 
condition  (e.g.,  the  existence  of  plans  for  the  nefarious  use  of  a  capability).”'^  The 
collection  of  this  information  would  particularly  aid  in  the  disambiguation  of  intentions 
regarding  dual-use  technologies,  in  which  existing  information  neither  confirms  nor 
disconfirms  hypothesis  regarding  threat,  or  in  “closed”  situations  in  which  traditional 
intelligence  is  scarce. 


^  Intelligence  Advanced  Research  Projects  Activity 
^  Explained  in  Section  2.2 
Adapted  from  internal  program  memo 
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2.  Background  and  Context 


We  begin  by  placing  the  key  issues  in  context,  first  by  noting  insights  from  the  social 
sciences  and  then  by  highlighting  some  key  system  dynamics  modeling  features. 

2.1  Determinants  of  Nefarious  Technology  Development 

The  development  of  nefarious  technologies  is  a  process  shaped  by  several  determinants, 
and  there  are  multiple  modes  of  technology  development  as  well  as  different  paths 
toward  a  range  of  technology  ‘end  points’.  To  begin,  we  identify  three  general 
classifications  of  determinants  towards  nefarious  technology  development:  internal, 
external,  and  technological.  These  determinants  are  adapted  from  the  context  of  nuclear 
proliferation  developed  in  The  Correlates  of  Nuclear  Proliferation:  A  Quantitative  Test 
[Singh  and  Way,  2004],  and  form  a  starting  point  for  modeling  nefarious  technologies. 
Internal  determinants  emphasize  a  variety  of  domestic  factors,  including  leadership, 
methods  for  control,  and  physical  inputs  such  as  production  capacity,  equipment,  raw 
materials,  and  workforce.  External  determinants  emphasize  the  incentives  or 
disincentives  provided  by  the  security  environment.  Technological  determinants 
emphasize  the  role  that  characteristics  of  particular  technologies  play  in  the  nefarious  and 
benign  applications,  such  as  cost,  stage  of  development,  and  economic  benefits. 

In  general,  internal  determinants,  subject  to  leadership,  steering,  and  coordination,  can  be 
combined  to  create  a  feasible  level  of  technology  development.  Countries  or 
organizations  with  high-levels  of  inputs  (such  as  a  highly-trained  workforce)  and 
extensive  steering  mechanisms  (such  as  private-public  research  partnerships)  will,  on 
average,  be  able  to  coordinate  and  develop  more  complex  technologies.  The  feasible  level 
of  technological  development  will  constrain  desired  development  of  technology,  both 
benign  and  nefarious.  Technological  determinants  will  further  shape  the  direction  of 
development.  For  example,  certain  biotechnologies  may  have  greater  overlap  between 
benign  and  nefarious  applications  than  nuclear  technologies.  Both  the  internal  and 
technological  determinants  operate  in  a  context  which  includes  external  actors  that  can 
alter  internal  determinants  (through  aid  or  tariffs)  or  technological  determinants  (through 
international  treaties  or  organizations).  The  broad  relationship  among  determinants  is 
shown  in 
Figure  1. 
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Figure  1.  Roadmap  of  Technology  Determinants 

2.2  System  Dynamics 

We  utilize  the  system  dynamic  modeling  methodology  to  model  the  dynamics  of 
technology  development  and  detection.  The  following  description  of  system  dynamics 
can  also  be  found  in  '"Linkages  between  Pre-  and  Post-Conflict:  Exploiting  Information 
Integration  and  System  Dynamics ."{Chomci  et  al,  2006]  “System  dynamics  is  an 
approach  for  modeling  and  simulating  (via  computer)  complex  physical  and  social 
systems  and  experimenting  with  the  models  to  design  policies  for  management  and 
change  [Forrester,  1958].  The  core  of  the  modeling  strategy  is  representation  of  system 
structure  in  terms  of  stocks  and  of  flows.  In  this  connection,  feedback  loops  are  the 
building  blocks  for  articulating  the  dynamics  of  these  models  and  their  interactions  can 
represent  and  explain  system  behavior. 

Created  by  Jay  Forrester,  system  dynamics  modeling  (SDM)  has  been  used  as  a  method 
of  analysis,  modeling  and  simulation  for  over  50  years.  SDM  has  been  used  for  a  wide 
range  of  purposes,  such  as  to  capture  the  dynamic  relationship  of  energy  and  the 
economy  [Sterman,1981],  to  model  the  world  petroleum  market  over  a  period  of  three 
decades  [Choucri,  1981],  to  explore  dynamics  of  economic  growth  [Choucri  and 
Bousefield,  1978]  to  analyze  the  environmental  implications  of  international  trade 
[Lofdahl,  2002],  to  understand  supply-chain  management  [Angerhofer  and  Angelides, 
2000],  to  analyze  different  policies  for  nation-building  [Robbins,  2005],  to  model 
software  development  [Abdel-Hamid  and  Madnick,  1991],  and  to  examine  the  intricacies 
of  the  Air  Force  command  and  control  systems  [Lofdahl,  2005]. 
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SDM  offers  unique  eapabilities  to  eontribute  to  soeial  seienee,  eeonomies,  or  politieal 
seienee  modes  of  analysis.  SDM  reeognizes  the  eomplex  interaetions  among  many 
feedback  loops,  rejects  notions  of  linear  cause-and-effect,  and  requires  the  analyst  to  view 
a  complete  system  of  relationships  whereby  the  ‘cause’  might  also  be  affected  by  the 
‘effect’.  SDM  enables  analysts  to  uncover  ‘hidden’  dynamics.  Moreover,  SDM  allows 
the  analyst  an  increased  level  of  flexibility  as  SDM  utilizes  both  conceptual 
understanding  as  well  as  empirical  data  collection.  As  Forrester  explains,  “the  first  step 
[in  SDM]  is  to  tap  the  wealth  of  information  that  people  possess  in  their  heads.  The 
mental  data  base  is  a  rich  source  of  information  about  the  parts  of  a  system,  about  the 
information  available  at  different  points  in  a  system,  and  about  the  policies  being 
followed  in  decision  making.”  [Forrester,  1991] 

The  system  dynamics  modeling  process  translates  these  elements  of  causal  logic  into 
systems  of  difference  equations  and  differential  equations  [Forrester,  1980].  Empirical 
analysis  is  also  used  to  explain  the  relationships  between  individual  elements  in  the 
overall  system.  By  understanding  the  dynamics  of  a  system,  including  interactions 
among  actors,  actions,  structures  and  processes  in  complex  environments,  one  can  better 
identify  how  to  reinforce  a  state’s  capabilities  while  diminishing  the  loads  and  pressures 
exerted  upon  it. 
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3.  Modeling  for  Pro-Active  Intelligence 


3.1  Overview  of  Process 

We  address  the  dynamics  of  technology  policy  and  support  the  identification  of 
opportunities  for  active  intelligence  through  combining  two  modeling  strategies:  (a) 
developing  an  independently  operating  system  dynamics  model  (with  potential 
extensions  in  other  modeling  methodologies  noted),  and  (b)  modeling  a  specific  area  of 
interest  (resources)  as  part  of  an  integrated  multi-methodology  system.  The  first  approach 
represents  a  potential  holistic  framework  to  develop  and  analyze  opportunities  in  active 
intelligence.  The  second  approach  drills  down  on  the  role  of  resources  in  an  integrating 
production  system  and  exchanges  information  across  modeling  methodologies  (such  as 
agent  base  modeling  and  discrete  event  simulation).  The  section  below  details  the  first 
approach;  details  of  the  second  approach  appear  in  Section  4. 

3.2  Proof  of  Concept:  Holistic  SDM  for  Active  Intelligence 

For  modeling  purposes,  the  first  step  is  to  define  the  overall  domain  and  system  of 
elements  that  contribute  to  the  development  of  nefarious  technologies  (see  Figure  1).  This 
step  yields  a  high  level  view  that  is  used  for  framing  purposes,  consistent  with  lines  of 
thinking  in  the  social  sciences.  The  next  step  is  to  select  and  ‘drill  down’  on  potential 
narratives  to  develop  a  ‘causal  diagram’  that  shows  the  processes  active  in  the  overall 
system. 

We  have  created  a  high-level  causal  loop  diagram  that  captures  the  key  elements  of  the 
system  in  question  including  the  major  feedback  loops.  Unlike  in  traditional  social 
science,  in  this  diagram  there  is  no  one  ‘dependent  variable’  that  reflects  the  overall 
stability  status  of  the  state;  rather  there  are  a  whole  range  of  potentially  significant  joint 
dependencies  that  capture  overall  system  behavior  and  performance. 

3.3  Causal  Mapping 

The  nature  of  research  in  this  area  makes  it  difficult  to  derive  the  causal  specifications  on 
specific  case  studies.  However,  we  have  identified  one  potential  archetype  shown  in 
Figure  2.  This  causal  mapping  doesn ’t  preclude  extensions  or  modifications  for  potential 
case  studies;  its  use  is  to  demonstrate  a  starting  point  for  modeling  nefarious  technology 
activities  holistically.  Alternative  cases  exist  in  which  the  polarities  (causal  relations) 
may  be  different;  however,  the  logic  captured  here  articulates  one  integrated  theory- 
driven  view  of  the  pressures  towards  and  against  nefarious  activities.  When  applied  to 
alternative  case  studies,  modifications  and  additions  would  be  necessary.  The  main 
function  of  this  section  is  to  demonstrate  the  methodology  by  which  causal  relations  can 
be  developed  into  a  roadmap  that  assists  in  quantitative  model  development. 
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Our  formulation  draws  upon  diverse  literature  across  determinants:  a)  threat  and  threat 
perceptions:  [Jervis,  1970;  1971],  [North,  1990],  [Holsti,  1962;  1972],  [George,  1969; 
1980],  [Schelling,  1963];  b)  leadership:  [Allison,  1969],  [Allison  and  Zelikow,  1999], 
[Almond  and  Powell,  1966],  [Wilson,  1989];  c)  economic  costs:  [Weil,  2005  ],  [Rodrik, 
2007];  and  d)  technology  pathway  connections:  [Wildavsky,  1988];  [Jervis,  1997]. 

In  Figure  2,  four  feedback  loops  are  shown,  labeled  either  “R”  for  reinforcing  feedback 
(increasing  x  causes  more  x),  or  “B”  for  balancing  feedback  (increasing  x  causes  less  x). 
Loop  B1  captures  one  intended  rationale  for  developing  a  nefarious  program  (or 
stockpile).  In  the  notional  case  B1  selected,  nefarious  capabilities  increase  the  deterrent 
effect  to  external  threats,  thus  lowering  or  balancing  the  perceived  threat  and  the 
necessity  for  future  nefarious  activity.  Loop  R1  provides  another  driver  of  nefarious 
development — government  consolidation.  The  logic  here  is  as  follows:  as  government 
consolidation  (alignment  of  leadership  towards  a  certain  goal)  increases,  it  allows  for  the 
expansion  of  nefarious  capabilities  and  development.  This  reduces  external  threat  through 
the  deterrence  effect,  and  allows  for  even  greater  consolidation  (the  reinforcing  effect). 

Other  Factors 


Figure  2.  Causal  Framework  for  Nefarious  Activities 
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The  logic  in  loops  B2  and  B3  show  key  constraints  on  the  development  of  nefarious 
technologies.  In  B2,  developing  a  nefarious  stockpile  has  the  consequence  of  limiting 
benign  production,  which  would  have  otherwise  returned  economic  gains.  As  economic 
costs  accrue  from  pursuing  nefarious  development,  popular  support  diminishes,  reducing 
government  consolidation  and  the  desire  to  pursue  nefarious  development.  Similarly, 
international  sanctions  (loop  B3)  in  response  to  nefarious  development  can  negatively 
impact  the  economy,  and  act  through  the  same  pathway  as  loop  B2  to  constrain  nefarious 
development. 

Taken  as  a  whole,  the  causal  loops  represent  a  range  of  potential  dynamics  in  nefarious 
development.  In  each  particular  case,  each  loop  will  operate  differently;  for  example, 
some  regimes  will  be  more  responsive  to  sanctions  than  others,  and  the  same  regime  will 
vary  its  response  depending  on  other  prevailing  conditions.  However,  developing  a 
causal  framework  allows  for  a  common  platform  to  compare  and  contrast  different 
narratives.  In  cases  in  which  the  logic  fails  to  explain  observed  behavior,  additions  and 
modifications  will  be  necessary. 

3.3  Simulation  Model 

The  task  after  developing  the  initial  causal  logic  is  to  formulate  the  overall  computational 
system  dynamics  model  for  simulation  and  analytic  purposes.  The  computational  system 
itself  consists  of  interconnected  modules  that  represent  different  facets  of  the  overall 
processes  at  hand. 

Our  model  is  constructed  of  four  major  subsections:  a)  benign/nefarious  production;  b) 
leadership  decision  making;  c)  external  actors;  and  d)  resource  inputs.  We  discuss  each 
subsection  below  by  showing  partial  visuals  of  the  integrated  system.  The  complete 
listing  of  equations  can  be  found  in  Appendix  A. 

An  overview  of  the  production  subsection  is  shown  in  Figure  3.  The  overarching  logic  is 
that  resource  inputs  define  a  potential  level  of  production,  which  can  be  allocated  in 
different  fractions  to  benign  or  nefarious  production.  Starting  at  the  bottom  of  the  figure, 
four  production  inputs  (raw  materials,  participants,  production  capacity,  and  equipment) 
determine  ‘potential  production,’  modeled  using  a  Cobb-Douglas  formulation.  [Sterman, 
1981]  Potential  production  is  modified  by  desired  production  and  a  capacity  utilization 
effect  to  determine  ‘scheduled  production.’  The  total  scheduled  production  is  then  split 
(‘fraction  nefarious’)  into  benign  and  nefarious  production  pipelines,  set  by  a  leadership 
input  (‘ind[icated]  fraction  for  nefarious  production’).  Two  stocks  (rectangles),  ‘nefarious 
FGI^’  and  ‘benign  FGI,’  represent  the  end  result  of  production  activity.  Overall 
production  in  this  module  is  treated  at  an  aggregate  level;  however,  there  exists  rich 
opportunities  to  link  production  inputs  into  different  models  (utilizing  different 
methodologies,  when  appropriate)  that  could  model  specific  production  lines  at  a  higher 
resolution. 


^  Finished  Goods  Inventory,  terminology  commonly  used  to  represent  stocks  in  system  dynamics  modeling. 
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Figure  3.  Causal  Framework  for  Nefarious  Activities 


The  leadership  decision-making  subsection  is  shown  in  Figure  4.  The  overarching  logic  is 
that  changes  in  inputs  to  leadership  decision  making  will  move  leadership  towards  or 
away  from  nefarious  intentions.  The  top  half  of  the  sub-section  combines  four  inputs  into 
leadership  decision  making:  a)  threat  perception;  b)  leadership  consolidation;  c)  pathway 
progress;  and  d)  external  effects  (sanctions).  The  effects  are  multiplicative  and  each 
effect  is  modeled  using  non-linear  functions.  The  lower  section  of  the  figure  calculates 
how  relative  changes  in  the  four  leadership  inputs  function  to  update  leadership’s 
decisions  about  nefarious  production.  For  example,  the  higher  the  threat  perception,  the 
more  likely  the  leadership  will  be  to  pursue  nefarious  production,  all  else  equal. 


Preferences  for  nefarious  production  are  modeled  using  an  anchor-and-adjustment 
structure.  Anchoring  is  a  cognitive  bias  that  describes  the  tendency  to  rely  on  an  "anchor” 
to  one  trait  or  piece  of  information  when  making  decisions,  and  then  adjust  it  to  account 
for  new  factors  or  pressures  (Tversky  &  Kahneman,  1974).  In  the  model  section  below, 
the  anchor  is  represented  by  the  preference  for  nefarious  development  ‘underlying 
percentage  for  nefarious  production.’)  This  anchor  is  then  adjusted  over  time  for  changes 
in  the  other  leadership  inputs. 
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Figure  4.  Leadership  Inputs 


The  leadership  module  is  also  a  rich  area  for  extensions  into  other  modeling 
methodologies.  For  example,  other  leadership  models  (utilizing  agent-based  modeling, 
for  example)  could  provide  inputs  for  changes  in  the  four  leadership  inputs. 


External  effects  on  the  overall  system  are  shown  in  Figure  5.  The  overarching  logic 
represented  is  how  external  actors  perceive  potential  nefarious  threats  and  take  action  in 
response.  The  left  side  of  the  figure  serves  to  calculate  an  external  ‘perceived 
nefariousness’  as  a  function  of  perceived  participation  and  perceived  production.  The 
bohom  right  side  of  the  figure  functions  as  a  sanctions  effect  (‘indicated  desired 
sanctions’),  by  which  external  actors  respond  to  increases  in  perceived  nefarious  activity. 
The  top  right  side  represents  the  leadership’s  response  to  sanctions;  if  sanctions  are 
active,  the  internal  regime  perceives  a  greater  external  threat  (‘actual  threat’)  which  is 
incorporated  into  their  decision  making  (as  shown  in  Figure  4  above.) 
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Figure  5.  External  Inputs 

Resource  inputs  are  the  final  subsection  of  the  integrated  system.  The  overarching  logic  is 
that  individual  resources  have  different  dynamics  that  will  determine  resource  availability 
or  lack  thereof  in  the  production  process.  Section  four  below  delves  deeper  into  resource 
modeling,  and  we  therefore  show  one  resource  specific  input  here  as  way  of  illustration 
(a  full  listing  is  found  in  Appendix  A). 

Individual  resources  can  be  modeled  at  different  granularity,  but  the  key  here  is  how 
resource  availability  impacts  the  overall  context  of  production,  decision  making,  and 
external  actions.  Figure  6  introduces  resource  modeling  and  depicts  the  pipeline  of  raw 
materials  necessary  for  production.  The  resource  is  modeled  using  a  standard  system 
dynamics  formulation  for  updating  an  ordering  pipeline.  [Sterman,  2000]  The  logic  is  as 
follows:  as  more  raw  materials  are  used  in  production  (‘raw  materials  consumption  rate’), 
a  ‘resource  gap’  increases  which  triggers  the  ordering  of  new  material  (‘raw  material 
order  rate’).  After  an  intermediate  delay  (‘raw  materials  on  order’),  the  materials  become 
available  for  further  consumption.  Of  dynamic  impact  are:  reordering  policies,  system 
delays,  and  management  of  inventory  on  order. 
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Figure  6.  Resource  Inputs 


3.4  Simulation  Analysis 

We  show  here  three  sets  of  SDM  results,  namely  (a)  identifying  and  simulating  probes; 
(b)  using  probe  analysis  to  triangulate  leadership  preferenees;  and  e)  demonstrating 
potential  unintended  eonsequenees.  The  analysis  shown  is  to  demonstrate  a  methodology 
of  simulation  based  active  intelligence;  it  demonstrates  a  proof-of-concept  for  using 
simulation  analysis,  which  is  produced  using  a  model  parameterized  to  notional  but 
plausible  values. 

3.4.1  Simulation  Analysis  to  Identify  Probes  and  Create  Diagnostic 


Effects 


We  show  here  several  sets  of  SDM  results  from  simulating  the  integrated  model.  The  first 
simulation  set  in  Figure  7  depicts  a  process  by  which  probe  candidates  are  developed.  On 
the  bottom  of  the  figure  are  three  resource  inputs:  materials,  people,  and  equipment.  The 
three  resource  inputs  combine  to  allow  an  overall  level  of  production,  shown  on  top.  The 
X  axis  is  time,  measured  in  weeks,  and  the  y  axis  (without  scale  for  demonstration 
purposes)  is  in  number  of  units.  The  graph  on  the  top  shows  overall  production  given  the 
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Figure  7.  Developing  probe  candidates 


total  resource  context.  The  simulation  output  was  parameterized  with  the  help  of  subject 
matter  experts  (SMEs),  and  the  resource  behavior  observed  is  the  result  of  the  dynamic 
production  system.  For  example,  the  initial  stock  of  materials  is  used  for  production  but 
replenished  overtime  to  avoid  production  stops.  As  noted  by  “system  analysis”  in  Figure 
7,  overall  production  is  constrained,  and  as  noted  by  “sensitivity  identification,”  the  key 
resource  constraint  is  people.  For  this  scenario,  simulation  analysis  has  helped  identify 
“human  resources”  as  a  good  probe  area,  as  probes  to  other  areas  would  not  affect  the  key 
constraint  and  would  therefore  cause  lower  magnitude  effects  to  the  overall  system. 


The  next  set  of  simulations  depicts  the  results  of  a  probe  targeted  at  human  resources, 
such  as  hiring  away  key  personnel  (Figure  8).  An  assumption  is  made  that  the  benign 
production  rate  is  observable.  The  probe  is  then  run  on  two  models:  one  in  which  only  a 
benign  program  is  active  and  one  in  which  both  benign  and  nefarious  programs  are 
active.  Another  assumption  is  made  that  nefarious  production  would  take  precedence 
over  benign  production,  given  constraints,  in  the  nefarious  model. 


The  base  case,  without  a  probe,  is  shown  with  a  solid  line.  The  benign  model  is  shown 
with  a  long  dashed  line,  and  the  nefarious  model  is  shown  with  a  short  dashed  line.  The 
effect  of  the  event  lowers  production  in  the  benign  case.  But  if  a  nefarious  program  is 
active,  then  benign  development  is  lowered  even  further,  as  scare  resources  must  be 
pulled  out  of  benign  production  to  maintain  the  same  level  of  nefarious  production.  The 
difference  in  observable  production  provides  a  clear  and  measurable  signature  of  a 
nefarious  production. 
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3.4.2  Simulation  Analysis  to  Identify  Leadership  Characteristics 

The  analysis  in  the  section  below  builds  on  the  information  collected  via  probes  in  the 
case  above.  The  base  case  in  Figure  9  is  parameterized  using  information  gathered  from 
the  previous  probe  as  shown  in  Figure  8,  which  suggests  the  existence  and  potential  level 
of  nefarious  production.  To  build  on  this  probe,  an  assumption  is  made  that  a  key  system 
question  concerns  leadership  characteristics,  namely  how  consolidated  the  leadership  is 
around  pursuing  nefarious  production.  A  probe  is  designed  to  initiate  a  set  of  sanctions, 
with  the  desired  effect  of  reducing  nefarious  development. 


Nefarious  Production 


Figure  9.  Base  Case 


Low  consolidation  case.  The  results  of  the  probe  under  a  certain  set  of  leadership 
characteristics  (specifically,  a  low  degree  on  consolidation)  are  shown  in  Figure  10  using 
a  short-dashed  line.  The  probe  is  effective  over  time  at  reducing  nefarious  production,  as 
low  consolidation  and  the  probe  causes  preferences  to  move  away  from  nefariousness. 
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Nefarious  Production 


(economic  sanctions) 

Figure  10.  Probe  Results  with  Low  Leadership  Consolidation 

High  consolidation  case.  Figure  11  adds  an  addition  case,  one  with  high  degrees  of 
leadership  consolidation  (shown  in  the  long-dashed  line.)  In  this  case,  the  probe  does  not 
result  in  the  intended  or  expected  results;  instead  it  creates  an  oscillating  pattern  of 
development.  This  analysis  pinpoints  a  need  for  higher  fidelity  intelligence  on  leadership 
consolidation,  as  critical  signals  information  can  look  the  same  in  the  short  term. 


Nefarious  Production 


(economic  sanctions) 

Figure  11.  Probe  Results  Showing  Both  Low  and  High  Leadership  Consolidation 

Unintended  consequence.  One  unintended  consequence  of  the  probe  case  shown  in 
Figure  1 1  is  the  potential  for  mistaken  analysis.  Given  a  limited  set  of  observables,  such 
as  just  the  values  shown  by  the  two  points  highlighted  in  Figure  1 1  and  depicted  in  Figure 
12.  Without  the  SDM  simulation  analysis,  a  likely  conclusion  drawn  is  that  production  is 
declining  (by  extrapolating  the  data  points  on  the  left  side  of  Figure  12).  Flowever,  given 
the  context  provided  by  the  simulation  analysis,  this  is  actually  shown  to  be  part  of  a 
larger  pattern  of  behavior,  in  which  production  is  actually  falling  and  then  rising  (right 
side  of  Figure  12). 


14 


Nefarious  Production 


Nefarious  Production 


Time  (week) 


Figure  12.  Observable  Data  With  and  Without  Simulation  Analysis 

This  simulation  highlights  the  need  for  a  system-wide  perspeetive  in  which  new 
information  can  be  placed  in  context. 

3.4.3  Summary  of  Results 

The  complete  results  and  probe  methodology  demonstrated  above  are  summarized  in 
Figure  13.  The  figure  depicts  three  main  stages:  developing  probe  candidates,  running 
probes  to  develop  intelligence,  and  actively  probing  to  shape  development. 
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Figure  13.  Summary  of  Probe  Methodology  and  Results 


In  summation,  we  have  (a)  demonstrated  a  fully  integrated  system  dynamics  model 
derived  from  theory  to  test  multiple  hypothesizes  concerning  technology  development; 
(b)  provided  simulations  that  support  an  overarching  probe  strategy,  consisting  of 
sequential  probes,  to  iteratively  improve  system  intelligence;  and  (c)  identified  “hooks” 
for  integration  with  multiple  models,  specifically  leadership  and  alternative  fidelity 
pathway  models. 
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4.  Modeling  Resources  as  Part  of  an  Integrated  Multi-Methodology 

System 


An  additional  line  of  research  was  conducted  into  modeling  resource  dynamics  as  part  of 
an  integrated  multi-methodology  approach.  The  focus  of  this  was  to  integrate  multiple 
modeling  approaches  to  develop  active  probes  that  determine  the  direction  of  technology 
development  at  a  target  organization.  In  particular,  the  case  concerned  the  development 
of  a  vaccine  that  could  entail  both  benign  and  nefarious  applications.  The  basic 
integration  structure  is  shown  in  Figure  14.^  Key  components  include:  a  social  network 
model  that  would  address  high-level  leadership  and  decision-makers;  a  decision  model 
that  would  represent  management  level  decisions;  discrete  event  simulation  models  that 
would  represent  various  stages  in  the  pathway  of  research  and  development;  a  resource 
model  that  would  represent  critical  assets  in  the  development  process,  controlled  by 
different  organizations;  and  a  backplane  that  would  serve  as  a  data  exchange  among  the 
different  models. 


Figure  14.  Simple  Integration  Structure 


The  resource  model,  built  utilizing  the  system  dynamics  methodology,  was  designed  with 
four  main  objectives:  (a)  identify  and  model  resource  dynamics  across  multiple 
organizations;  (b)  analyze  how  resource  probes  create  meaningful  system  changes  and 
produce  high  diagnostic  value;  (c)  anticipate  intended/unintended  consequences  from 
probes;  and  (d)  allow  for  meaningful  interaction  with  other  modeling  methodologies. 

Specifically,  the  modeling  provided  resource  levels  and  quality  for  four  main  resource 
groups:  human  (people,  skill  level),  operating  (physical  infrastructure,  equipment), 
materials  (production  inputs),  and  financial  (available  capital,  funding  sources).  It  also 
allowed  for  interactions  with  both  the  pathway  and  decision  models:  resource  levels  and 
availability  would  be  passed  to  the  pathway  model,  which  would  return  resource  usage, 
and  resource  shortfalls  would  be  passed  to  the  decision  models,  which  would  return 


®  Adapted  from  an  internal  memo.  The  basie  underlying  integration  strueture  is  shown  in  the  figure,  though 
not  all  methodologies  involved  in  the  projeet  are  shown. 
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decisions  on  resource  management  or  acquisition  policy.  Probe  candidates  generated 
include  imposing  resource  limitations  and  disrupting  supply  chains.  A  drill  down 
schematic  of  the  resource  area  is  found  in  Figure  15.  The  two-way  interactions  with 
decision  and  pathway  models  are  labeled  with  arrows.  Also  depicted  in  the  dashed  box 
are  three  outside  suppliers  of  materials,  which  we  model  separately,  that  provide 
materials  input  for  the  target  organization. 


Decision 

Models 


Figure  15.  Resource  Model  Overview 


A  sample  probe  narrative  is  shown  in  Figure  16. 


Figure  16.  Sample  Probe  Narrative 
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1.  Resources  are  constrained  by  a  simulated  probe  (for  example,  hiring  employees 
away  from  the  target  organization); 

2.  Delays  are  created  in  the  various  pathways,  VI (benign)  and  V2(nefarious); 

3.  The  decision  model  observes  and  responds  to  these  constraints; 

4.  A  decision  is  made  to  reallocate  the  scarce  resource  away  from  VI (benign) 
towards  V2 (nefarious); 

5.  The  pathway  model  tracks  the  restoration  on  the  V2(nefarious);  and 

6.  The  stoppage/reduction  in  VI (benign)  is  observable,  and  its  schedule  stoppage  in 
response  to  the  probe  indicates  the  existence  of  the  V2(nefarious)  line. 

The  narrative  is  also  demonstrated  through  system  dynamics  simulation  output  in  Figure 
17.  The  solid  line  represents  the  base  case  (often  in  equilibrium  on  the  axis)  and  the 
dashed  line  represents  the  probe  case.  As  described  in  the  sample  narrative  above,  a  probe 
increases  the  loss  of  workforce  (bottom  left),  creating  a  decline  in  workforce  and 
experience  (middle).  The  leadership  responds  by  increasing  hiring  (top  left),  though 
while  the  workforce  recovers  there  are  delays  in  pathway  progress  (far  right). 
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Figure  1 7.  Resource  Probe  Simulation  Output 
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The  simulation  model  structure  utilized  in  the  integrated  model  is  discussed  below.  Full 
documentation  of  the  resource  model  can  be  found  in  Appendix  For  descriptive 
purposes,  we  display  one  resource  segment,  workforce,  in  detail  below  (Figure  18).  The 
human  resource  model  is  shown  in  Figure  18  and  is  partitioned  into  subsections;  human 
resources,  decision  model  input,  and  probe  input.  The  human  resources  segment  contains 
two  stocks,  accounting  for  both  the  quantity  and  quality  of  the  workforce  given  changes 
in  the  workforce  flows  (‘hiring’  and  ‘attrition’).  The  decision  model  segment  contains 
leadership  inputs,  such  as  the  desired  level  of  workforce  and  the  time  with  which  to 
adjust  workforce.  The  probe  section  contains  inputs  to  simulate  a  probe  to  reduce 
workforce  (‘workforce  reduction’). 


Human  Resources 

Figure  18.  Illustrative  Resource  Structure 


An  additional  piece  of  reference  structure — materials  suppliers — are  shown  in  Figure  19. 
Three  key  subsections  are  shown:  supply  chain  adjustment,  quality  adjustment,  and 
preference.  This  structure  represents  each  (we  use  three  suppliers  in  the  integrated 
system)  supply  chain.  The  logic  is  as  follows:  ‘total  demand’  and  ‘preference  for  supply 
chain’  (in  the  preference  section)  determine  the  total  demand  for  each  supplier.  The 
supply  chain  adjustment  section  contains  the  allocation  mechanism  by  which  suppliers 
try  to  meet  changes  in  demand.  This  section  contains  supplier  specific  characteristics, 
such  as  efficiency  and  speed.  The  quality  adjustment  section  tracks  the  ongoing  average 
quality  of  materials  as  old  materials  exit  the  system  and  new  materials  enter. 


’  The  full  model  provides  resouree  levels  and  quality  for  ten  key  resourees  aeross  four  main  resouree 
groups  for  the  integrated  system 
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Supply  Chain  Adjustment  Desired  Inventory 

Figure  19.  Supplier  Model  Structure 


Modeling  different  supply  chains  allows  for  tests  concerning  the  vulnerability  of  each 
supplier  and  helps  identify  likely  probe  candidates.  In  Figure  20,  the  results  of  a  probe 
executed  on  the  three  supply  chains  are  shown. 


Differences  in  supply  chains  are  modeled  by  varying  the  supplier’s  average  fulfillment 
delay  and  their  efficiency  in  managing  supply  chain  buffers.  A  less  vulnerable  supplier 
would  be  able  to  quickly  and  smoothly  adjust  their  available  inventory  to  variations  in 
ordering,  while  a  vulnerable  supplier  would  be  unable  to  manage  changes  in  ordering  and 
would  create  oscillations  throughout  the  supply  chain. 
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Supply  chain  analysis  supports  probe  identification:  while  supplier  one  is  resilient  to 
supply  chain  disruptions,  suppliers  two  and  three  show  vulnerabilities.  Further,  while 
supplier  three  is  able  to  recover  smoothly  from  disruption,  supplier  two  begins  to 
oscillate,  likely  creating  greater  downstream  disruptions.  Therefore,  given  the  three 
different  suppliers,  a  probe  aimed  at  supplier  three  will  likely  have  the  most  meaningful 
impact  on  the  pathway  model. 
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5.  Formalizing  Pro-Active  Intelligence  Probes 


Up  to  this  point  we  have  informally  defined  active  intelligence  probes  as  an  action  or 
stimulus  designed  to  produce  system  behaviors  (active  probe)  or  to  collect  data.  In  this 
section,  we  introduce  the  basics  of  a  more  formalized  definition  and  notation  of 
intelligence  probes  that  may  serve  as  a  potential  roadmap  for  future  investigations  into 
probes. 

Specifically,  a  probe  is  defined  as  an  act  or  set  of  acts  that  are  initiated  starting  at  some 
time  ‘t’  with  the  goal  to  directly  affect  one  or  more  measurable  system  attributes  over 
some  time  period.  The  effect  of  the  probe  is  to  change  measurable  system  attributes  for 
the  purpose  of  achieving  a  desired  outcome.  A  desired  outcome  may  be  to  gain  useful 
information  or  to  move  the  system  in  a  preferred  direction  (active  probe). 

Formally,  Pi({xi},  t,  {yk})  is  defined  as  a  Probe  Pi  to  affect  one  or  more  system 
attributes,  {xi,  X2,  ...,  Xm}  (=  {xi}),  starting  at  time  t,  with  the  purpose  of  a  desired 
outcome  on  one  or  more  system  attributes  {yi,  yi,  . . .,  yn}  (=  {yk})  (where  a  given  yk  may 
or  may  not  be  the  same  as  some  xi). 

Additional  definitions: 

•  Pi(ti)  -  simplified  from  Pi  (|xd,  t,  {yk}) 

•  Si({Pi(ti),  P2(t2)....},  tn)  -  a  strategy  plan  Si  as  planned  at  time  U 

•  Ayl  (Pi(ti),  tn)  -  the  intended  change  of  y  from  probe  Pi(ti)  as  predicted  at  time  U 

•  AyA  (Pi(ti),  tn)  -  the  actual  change  in  y  from  probe  Pl(tl)  as  observed  at  time  U 

•  AyA  (Ei(tm),  tn)  -  the  actual  change  in  y  from  some  other  event  as  observed  at 
time  tn 

Figure  21  shows  a  formalized  probe  strategy  overtime. 


Further  formalization  of  “probe  theory”  combined  with  simulation  and  analysis  is  an 
important  step  towards  developing  a  theory  of  active  intelligence.  Together  these  can 
provide  the  underlying  equations  for  representing  systems  and  their  interactions.  These 
coupled  with  events  and  actions  that  are  observed  in  the  system  can  provide  new  insights 
into  the  actions  of  an  entity  and  the  detection  of  unwanted  behavior. 
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6.  Conclusion 


6.1  Summary 

This  research  effort  addresses  four  broadly  stated  goals: 

(1)  to  develop  models  of  the  development  processes  of  current  or  emergent 
technologies  that  may  threaten  the  US; 

(2)  to  identify  factors  and  strategies  that  may  influence  the  evolution  of  these 

threats; 

(3)  to  develop  methods  for  determining  comprehensive  indicators  of  these  threats 
using  active  intelligence;  and 

(4)  to  demonstrate  how  real  world  data  and  key  indicators  can  be  used  to  adjust 
models  and  develop  model-based  influence  strategies. 

We  have  demonstrated  the  capability  of  using  the  system  dynamics  modeling 
methodology  to  meet  those  four  goals,  both  in  stand-alone  holistic  models  and  as  part  of 
an  integrated  multi-methodology  system. 

6.2  Future  Research 


In  the  future,  we  see  an  iterative  process  in  the  development  of  models  to  support  active 
intelligence. 


Identify  Theoretical 
Foundations 

Build  system  understanding 
(Case  study.  Casual  mapping) 


Identify  Needed  Extensions 
New  modeling  or 
model  integration 

Model  Building 
Identifying  mathematical 
formulations  to  render 
soecific  cases 

Experiment 
Simulations,  Testing, 
Verification 


Figure  22.  Overview  of  Methodology 
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The  modeling  approaeh  shows  an  iterative  system  in  whieh  model  advancement  is 
developed  from  the  dynamic  interactions  between  models,  system  users,  and  emerging 
data.  A  typical  approach,  shown  in  (Figure  22),  would  be  as  follows: 

•  Develop  a  systems  overview  from  literature  and  case  studies  that  bounds  the 
problem  and  identifies  likely  dynamics 

•  Initiate  model  building  that  structures  the  best  current  thought  (including  differing 
perspectives)  and  data  on  the  system  of  interest 

•  Generate  likely  outcomes  and  testable  hypothesis  from  model  analysis  (i.e.  if  the 
model  is  accurate,  we  would  anticipate  the  following  outcome,  or  if  “x” 
perspective  is  correct,  we  should  observe  “y’’.) 

•  Test  these  hypotheses  with  active  intelligence  probes,  verify  with  naturally 
occurring  experiments,  and  compare  to  emerging  data.  A  naturally  occurring 
experiment  utilizes  the  occurrence  of  an  observable  phenomenon  to  approximate 
or  duplicate  the  properties  of  a  controlled  experiment.  These  events  aren’t  created 
by  design,  but  nonetheless  yield  valuable  data.  This  process  can  (a)  confirm 
model  assumptions,  or  (b)  identify  new  model  extensions  (i.e.  learn)  to  better 
represent  the  real  world 

•  Return  to  expanding  system’s  intelligence  with  new  information  and  continue  the 
process 

Future  research  in  this  area  could  be  based  on  the  reasoning  that  simulation  technologies 
are  necessary  to  operate  in  intelligence  environments  that  are  complex,  ambiguous,  and 
data  poor.  Innovative  simulation  technologies  would  exploit  opportunities  in  machine 
learning  to  iteratively  discover  and  validate  underlying  “system”  structure;  systems  could 
include  countries,  transnational  networks,  emerging  technologies,  or  WMD  threats.  The 
approach  would  be  predicated  on  combining  modeling  techniques,  expert  input, 
applicable  theory,  and  data  (as  it  becomes  available)  to  triangulate  likely  patterns  of 
future  behavior  as  well  as  high-leverage  policies  to  shape  desired  outcomes.  This  would 
lead  to  more  rapid  and  accurate  discovery  of  policy  determinants  and  options,  testable 
hypothesis  regarding  key  unknowns,  as  well  as  ensure  the  consistency  of  data  by 
embedding  it  in  a  more  accurate  framework. 

Unlike  prior  technologies  that  have  focused  on  machine  learning  to  create  cognitive 
systems  that  can  learn  and  reason  to  structure  massive  amounts  of  raw  data,  innovative 
programs  are  necessary  to  focus  on  “closed  systems”  in  which  key  system  attributes  are 
unknown  and  data  is  sparse,  unstructured,  and  potentially  unreliable.  New  technologies, 
such  as  the  system  dynamics  methodology  (SDM),  can  operate  in  these  difficult 
environments  and  can  combine  a  mix  of  techniques  to  better  “learn”  ground  truth.  New 
machine  learning  technologies  would  improve  existing  capabilities  to  validate  SDM 
models  by  assisting  to  update  the  models  themselves  to  reflect  emerging  information. 
Confidence  would  be  increased  in  “closed  systems”  as  SDM  modeling  projections  and 
available  data  combine  to  show  greater  consistency  over  time. 
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8.  List  of  Acronyms 


lARPA 

Intelligence  Advanced  Research  Projects  Activity 

FGI 

Finished  Goods  Inventory 

MIT 

Massachusetts  Institute  of  Technology 

NSI 

National  Security  Innovations 

PAINT 

ProActive  Intelligence 

SDM 

System  Dynamics  Modeling 

SME 

Subject  Matter  Experts 

WMD 

Weapons  of  Mass  Destruction 
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Appendix  A: 

Full  Simulation  Model  Equations 


Nefarious  FGI  Full  Effect  =IF  THEN  EESE  (EGI  Eractional  Gap<0.2,EGI  Eractional 
Gap^(l/5),1) 

Threshold  for  sanctions=0.05 

Actual  Sanctions=IF  THEN  EESE(endogenous  external  actor  switch=l, Indicated  Desired 
Sanctions*  Sanctions  Switch, 0) 

Actual  Sanctions  Effect=smoothi(Actual  Sanctions, Eeadership  sensitivity  to  sanctions,0) 
Actual  Threat=  IE  THEN  EESE(endogenous  external  actor  switch=l,smooth(Indicated 
Desired  Threat,time  to  mobilize  threat)*Threat  Switch,exogenous  threat) 

Actual  Threat  Perception= Actual  Threat 

endogenous  external  actor  switch=  Desired  Ecn 

Sensitivity  for  Sanctions=l 

exogenous  sanctions=  0.5 

exogenous  threat=.5 

time  to  mobilize  threat=  2 

time  for  EGI  to  decay=  26 

Decaying  Nefarious  EGI=Nefarious  EGI  Ed/time  for  EGI  to  decay 

Sanctions  Switch=  I 

Eeadership  sensitivity  to  sanctions=  26 

Indicated  Desired  Sanctions=  Desired  Threat  as  Ecn  of  Nefariousness(Perceived 

Nefariousness/threshold  for  sanctions)^Desired  Pen  Sensitivity  for  Sanctions 

EGI  Eractional  Gap=  Max(0,(max  nefarious  EGI-Nefarious  EGI  Ed)/max  nefarious  EGI) 

Initial  Nefarious  EGI=  100 

max  nefarious  EGI=  50000 

Threat  Switch=  1 

Nefarious  EGI  Ed=  INTEG  (  Nefarious  Production-Decaying  Nefarious  PGI,Initial 
Nefarious  EGI) 

Nefarious  Participants=  INTEG  (Mobilizing  Nefarious  Participants-Demobilizing 
Nefarious  Participants,0) 

Mobilizing  Nefarious  Participants=Nefarious  Participant  Gap/Avg  Time  to  Mobilize 
Nefarious  Participants 
nefarious  threshold=  0.2 
Reference  Nefarious  PGI=  10000 


Reference  Nefarious  Participants=  1 

Indicated  Desired  Threat=  Desired  Threat  as  Pen  of  Nefariousness(Perceived 
Nefariousness/nefarious  threshold)^\  Desired  Pen  Sensitivity 
Desired  Threat  as  Pen  of  Nefariousness([(0,0)- 


(2,I)],(0,0),(0.25,0.0I),(0.5,0.05),(0.67,0.I25),(0.8,0.25),(I,0.5),(I.2,0.75),(I.33,0.885),(I 


.5,0.95),(I.75,0.99),(2,I)) 


Desired  Pen  Sensitivity=I 


Nefarious  Participant  Gap=  Desired  Nefarious  Participants-Nefarious  Participants 
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Perceived  Nefarious  FGI  Index=smoothi(Nefarious  FGI  Ed/Reference  Nefarious 
FGI,Time  to  Prcv  Nef  FGI,0) 

Perceived  Nefarious  Particpant  Index=smoothi(Participant  Ratio/Reference  Nefarious 
Participants, Time  to  Prcv  Nefarious  Participants, 0) 

Perceived  Nefariousness=Max(Perceived  Nefarious  FGI  Index,weight  on  FGI*Perceived 

Nefarious  FGI  Index+weight  on  particpants  *Perceived  Nefarious  Particpant  Index) 

Time  to  Prcv  Nef  FGI=4 

Time  to  Prcv  Nefarious  Participants=26 

Total  Participants=Active  Participants+Nefarious  Participants 

weight  on  particpants=0.2 

weight  on  FGI=0.5 

Demobilizing  Nefarious  Participants=(Nefarious  Participants/ Avg  Time  to  Demobilize 
Nefarious  Participants)* Switch  for  Demobilizing  Nefarious  Participants 
Initial  PE=  INITIAL(  Desired  Equipment) 

Actual  Eeadership  Consolidation=  1000 
Switch  for  Pathway  feedback=l 

Effect  Of  Progress  on  Nefariousness=Effect  Of  Progress  on  Nefariousness  f  (  Relative 
Progress ) 

Relative  Progress=Pathway  Progress  /  Reference  Pathway  Progress 

Pathway  Progress=(Nefarious  EGI  Ed*Switch  for  Pathway  feedback)+((l -Switch  for 

Pathway  feedback)*  10) 

Effect  Of  Progress  on  Nefariousness  f([(0,0)(2,2)],(0,0),(0.25, 0.35), (0.5,0. 65), 
(0.75,0.85),(1,1),  (1.25,1. 1),(1.5, 1.18) 

MinimumUnderlyingPercentage  for  Nefarious  Production=  0.1 
pressureToIncreaseNefariousness=  Effect  O  fLeadership  Consolidation  on 
Nefariousness* Effect  Of  Progress  on  Nefariousness  *Effect  Of  Economic  Sanctions  on 
Neafriousness* Effect  Of  Threat  Perception  on  Nefariousness 

Eraction  Nefarious=Ind  Eraction  for  Nefarious  Production*Nefarious  EGI  Eull  Effect 
Reference  Economic  Sanctions=0.5 
Reference  Eeadership  Consolidation=10 

Effect  Of  Threat  Perception  on  Nefariousness=Effect  Of  Threat  Perception  on 
Nefariousness  f  (  Relative  Threat  Perception ) 

Effect  Of  Threat  Perception  on  Nefariousness  ([(0,0)(6,4)],(0,0.5),(0.5,0.6),(0.75,0.75) 
,(0.9,0.9)  ,(1,1),(1.2,1.2),(1.5,1.5),(2.20183,2.10526), 
(3,2.5),(3.87156,2.78947),(5,3),(6,3)) 

EffectOfEconomic  Costs  on  Nefariouness 

f([(0,0)(4,4)],(0,2),(0.423529,1.56584),(0.649412,1.35231),(0.865882,1.13879),(l,l),(l.l 
3882,0.882562),(1.261 18,0.81 1388),(1.46824,0.725979),(2.34862,0.438596),(4,0)) 
Reference  Threat  Perception  Ed=  0.1 

Relative  Consolidation  =  Actual  Eeadership  Consolidation  /  Reference  Eeadership 
Consolidation 

Relative  Economic  Sanctions= Actual  Sanctions  Effect  /  Reference  Economic  Sanctions 
Relative  Threat  Perception  =  Actual  Threat  Perception  /  Reference  Threat  Perception  Ed 
ChangeInPercentage  for  Nefarious  Production=(  Indicated  Percentage  for  Nefarious 
Production  -  Underlying  Percentage  for  Nefarious  Production  )  /  Time  to  change 
Percentage  for  Nefarious  Production 
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Ind  Fraction  for  Nefarious  Production=IF  THEN  ELSE((Underlying  Percentage  for 
Nefarious  Production  *  pressureToIncreaseNefariousness<l  ,  (Einderlying  Percentage  for 
Nefarious  Production  *  pressureToIncreaseNefariousness\ 

),1) 

Indicated  Percentage  for  Nefarious  Production=Max(Ind  Eraction  for  Nefarious 
Production, MinimumEinderlyingPercentage  for  Nefarious  Production) 

Reference  Pathway  Progress  =10 

Effect  O  fLeadership  Consolidation  on  Nefariousness  f  ( [(0.5,0.8)- 

(2, 1.2)], (0.5, 1.2)\, (0.648235, 1.18861), (0.747059, 1.16726), (0.895294, 1.08897), (1,1), (1.18 

471,0.898221),\(1.42118,0.835587),(1.64353,0.814235),(2,0.8)) 

Effect  Of  Economic  Sanctions  on  Neafriousness=  EffectOfEconomic  Costs  on 
Nefariouness  f  (  Relative  Eeonomic  Sanctions  )/2 

Underlying  Pereentage  for  Nefarious  Produotion=  INTEG  (  ChangelnPereentage  for 
Nefarious  Production,  0.1) 

Effect  O  fLeadership  Consolidation  on  Nefariousness  =  Effeet  O  fLeadership 
Consolidation  on  Nefariousness  f(  Relative  Consolidation  ) 

Time  to  ehange  Pereentage  for  Nefarious  Production  =  3 

Active  Participants=  INTEG  (Demobilizing  Nefarious  Participants+Participant 

Aequisition  Rate-Mobilizing  Nefarious  Participants\,Initial  AP) 

Initial  RMOO=  INITIAL(  Target  Raw  Materials  in  Proeess) 

DC  Height=  0 
DC  Time=  0 

Initial  PC=  INITIAL(  Initial  Desired  Capaeity) 

Desired  Capaeity=  Initial  Desired  Capacity*(l-l-Test  Input  Desired  Capacity) 

Initial  AP=  INITIAL(  Desired  Participants) 

Initial  Desired  Capacity=  1000 

Initial  ES=  INITIAL(  Target  Equipment  Capacity  in  Process) 

Initial  PCS=  INITIAL(  Target  Production  Capacity  in  Process) 

Initial  PIT=  INITIAL(  Target  Participants  in  Process) 

Initial  RM=  INITIAL(  Desired  Raw  Materials) 

Test  Input  Desired  Capacity=  STEP(  DC  Height ,  DC  Time) 

Adding  Potential  Participants=  Max((Adjustment  to  Participant  Order 
Rate+Desired  Partieipant  Addition  Rate),0) 

Adjustment  to  Equipment  Order  Rate=  (Equipment  Gap  Adjusted  for  Pipeline/Time 
to  Adjust  EOR)*Equipment  Eunding 

Adjustment  to  Participant  Order  Rate=  (Participant  Gap  Adjusted  for  Pipeline/Time 
to  Adjust  POR)*Participant  Eunding 

Raw  Materials  Aequisition  Rate=  Raw  Material  on  Order/Time  to  Aequire  Raw  Matl 
Adjustment  to  Raw  Material  Order  Rate=  (Raw  Materials  Gap  Adjusted  for 
Pipeline/Time  to  Adjust  RMOR)*Raw  Material  Eunding 
Average  Lifespan  of  Equipment=  52 

Participant  Punding=  1 

Avg  Time  to  Demobilize  Nefarious  Participants=  52 
Avg  Time  to  Mobilize  Nefarious  Partioipants=  52 
Awareness  of  Equipment  in  Prooess=  1 

Awareness  of  Partieipants  in  Prooess=  1 


30 


Participants  in  Training=  INTEG  (  Adding  Potential  Participants-Participant 
Acquisition  Rate,  Initial  PIT) 

Awareness  of  Raw  Material  in  Proeess=  1 

Pereeived  Partieipants  in  Proeess=  Partieipants  in  Process  Gap* Awareness  of 
Participants  in  Process 

Equipment  Ratio=  Productive  Equipment/Reference  Equipment 

Pereeived  Raw  Material  in  Proeess=  Raw  Material  In  Process  Gap*  Awareness  of  Raw 

Material  in  Process 

Desired  Equipment=  1000 

Desired  Equipment  Order  Rate=  Retiring  Equipment 

Desired  Nefarious  Partioipants=  0 

Desired  Participant  Addition  Rate=  Mobilizing  Nefarious  Participants 
Desired  Participants=  1000 
Time  to  Adjust  EOR=52 
Desired  Raw  Materials=  1000 

Desired  Raw  Materials  Order  Rate=  Raw  Materials  Consumption  Rate 

Raw  Material  In  Proeess  Gap=  (Target  Raw  Materials  in  Proeess-Raw  Material  on 

Order) 

Effect  of  Equipment  on  Potential  Production=  Effect  of  Equipment  on  Potential 
Production  f(Equipment  Ratio) 

Effect  of  Equipment  on  Potential  Production  f(  [(0,0)-(2,l)],(0,0),(l,l),(2,l)) 

Raw  Material  Ratio=  Raw  Materials/Reference  Raw  Materials 

Effect  of  Participants  on  Potential  Production=  Effect  of  Participants  on  Potential 

Production  f(Participant  Ratio) 

Effect  of  Raw  Materials  on  Potential  Production=  Effeet  of  Raw  Materials  on  Potential 
Production  f(Raw  Material  Ratio) 

Raw  Materials  Consumption  Rate=  Implied  Raw  Materials  Usage  Rate 
Equipment  Aequisition  Rate= Equipment  On  Order/Time  to  Acquire  Equipment 
Time  to  Aequire  Equipment=  52 
Equipment  Funding=  1 

Equipment  Gap=  (Desired  Equipment-Productive  Equipment) 

Equipment  Gap  Adjusted  for  Pipeline=  Pereeived  Equipment  in  Proeess+Equipment 
Gap 

Equipment  in  Proeess  Gap=  (Target  Equipment  Capacity  in  Process-Equipment  On 
Order) 

Equipment  On  Order=  INTEG  (  Equipment  Order  Rate-Equipment  Aequisition 
Rate,  Initial  ES) 

Equipment  Order  Rate=  Max((Adjustment  to  Equipment  Order  Rate+Desired 
Equipment  Order  Rate),0) 

Raw  Material  Order  Rate=  Max(( Adjustment  to  Raw  Material  Order  Rate+Desired 

Raw  Materials  Order  Rate),0) 

Implied  Raw  Materials  Usage  Rate=  (Benign  Production+Nefarious  Production)*Raw 
Materials  per  Unit  of  Produetion 

Potential  Production=  Production  Capacity  *Effect  of  Raw  Materials  on  Potential 
Production*Effeet  of  Participants  on  Potential  Production\  *Effect  of  Equipment  on 
Potential  Production 
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Switch  for  Demobilizing  Nefarious  Partioipants=  1 

Target  Partieipants  in  Proeess=  Time  to  Aequire  Partioipants*Mobilizing  Nefarious 

Partieipants 

Initial  NP=  0 

Target  Raw  Materials  in  Proeess=  Time  to  Aequire  Raw  Matl*Raw  Materials 
Consumption  Rate 

Partieipant  Gap  Adjusted  for  Pipeline=Peroeived  Partieipants  in  Proeess+Partieipant  Gap 
Time  to  Adjust  POR=  52 

Raw  Material  on  Order=  INTEG  (  Raw  Material  Order  Rate -Raw  Materials 
Aequisition  Rate,  Initial  RMOO) 

Partieipant  Ration  Total  Partieipants/Reference  Partieipants 

Raw  Materials=  INTEG  (  Raw  Materials  Aequisition  Rate-Raw  Materials 

Consumption  Rate,  Initial  RM) 

Partieipant  Aequisition  Rate=  Partieipants  in  Training/Time  to  Aequire  Partieipants 

Time  to  Aequire  Participants=  52 

Raw  Materials  Gap=  (Desired  Raw  Materials-Raw  Materials) 

Partieipant  Gap=  (Desired  Partieipants- Aetive  Partieipants) 

Raw  Materials  Gap  Adjusted  for  Pipeline=  Pereeived  Raw  Material  in  Proeess+Raw 
Materials  Gap 

Raw  Materials  per  Unit  of  Produetion=  1 

Partieipants  in  Proeess  Gap=  (Target  Partieipants  in  Proeess-Partieipants  in  Training) 
Referenee  Raw  Materials=  1000 

Pereeived  Equipment  in  Proeess=  Equipment  in  Proeess  Gap*Awareness  of 
Equipment  in  Proeess 

Retiring  Equipment=  Produetive  Equipment/ Average  Eifespan  of  Equipment 
Referenee  Equipment=  1000 

Produetive  Equipment=  INTEG  (Equipment  Aequisition  Rate-Retiring  Equipment,Initial 
PE) 

Target  Equipment  Capaeity  in  Proeess=  Time  to  Aequire  Equipment*Retiring 
Equipment 

Time  to  Adjust  RMOR=  52 

Time  to  Aequire  Raw  Matl=  52 

Referenee  Partieipants=  1000 

Raw  Material  Eunding=  1 

Awareness  of  Production  Capacity=  1 

Adjustment  to  Produetion  Capacity=  (Produetion  Gap  Adjusted  for  Pipeline/Time  to 
Adjust  Produetion  Capaoity)*Produotion  Eunding 
Effeet  of  Eabor  Eoree  on  Produotion=  1 
Produetion  Eunding=  1 

Effeet  of  Partieipants  on  Potential  Production  f(  [(0,0)-(2,l)],(0,0),(l,l),(2,l)) 

Effect  of  Raw  Materials  on  Potential  Produetion  f(  [(0,0)-(2,l)],(0,0),(l,l),(2,l)) 
Produetion  Capaoity=  INTEG  (Proeessing  Produetion  Capaeity-Retiring  Production 
Capacity,  Initial  PC) 

Production  Gap  Adjusted  for  Pipeline=Peroeived  Produetoin  Capaeity  in 

Proeess+Produetion  Capaeity  Gap 

Time  to  Adjust  Produetion  Capaoity=  52 
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Perceived  Productoin  Capacity  in  Process=  Production  Capacity  in  Process 
Gap*  Awareness  of  Production  Capacity 

reduction  Capacity  in  Process  Gap=  (Target  Production  Capacity  in  Process-Production 
Capacity  Starts) 

Target  Production  Capacity  in  Process=Processing  PC  Time*Retiring  Production 
Capacity 

Production  Capacity  Gap=(Desired  Capacity-Production  Capacity) 

Nefarious  Production=Scheduled  Production*Fraction  Nefarious 
Desired  Production=  1000 

Benign  Production=Scheduled  Production*(l -Fraction  Nefarious) 

Average  Lifespan  of  PC=52 

Production  Capacity  Starts=  INTEG  (Starting  Production  Capacity-Processing 
Production  Capacity,  Initial  PCS) 

Processing  PC  Time=  52 

Benign  FGI=  INTEG  (Benign  Production,  Initial  Benign  EGI) 

Retiring  Production  Capacity=Production  Capacity/ Average  Eifespan  of  PC 
Starting  Production  Capacity=Max((Adjustment  to  Production  Capacity+Desired 
Productive  Capacity  Starts),0) 

Desired  Productive  Capacity  Starts=  Retiring  Production  Capacity 
Processing  Production  Capacity=Production  Capacity  Starts/Processing  PC  Time 
Desired  Utilization=Desired  Production/Potential  Production 
Initial  Benign  PGI=100 

Scheduled  Production=Scheduled  Capacity  Utilization*Potential  Production*Effect  of 
Eabor  Eorce  on  Production 

Scheduled  Capacity  Utilization  f([(0,0)  2,2)],(0,0),(0.25,0.35),(0.5,0.65),(0.75,0.85),(1,1), 
(1.25,1. 1),(1.5,1.18),(1.75,1.23),(2,1.25)) 

Scheduled  Capacity  Utilization=Scheduled  Capacity  Utilization  f(Desired  Utilization) 
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Appendix  B: 

Documentation  for  Resource  Model  in  Integrated  System 
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Figure  Bl:  Workforce 


Figure  B2:  Facilities  and  Equipment 
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Time  to  Close 
Capital  Gap 


Figure  B3:  Financial  Resources 
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Figure  B4:  Supply  Chain  Preferences 
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Initial  Quality  in 
Process 


Initial  Inventory 
Quality 


Figure  B5:  Raw  Materials 
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Equations 


Max  Inventory  Use  3=  10 

Total  Demand  Change=  Step  for  Total  Demand*  Total  Demand  Amount 
Step  for  Total  Demand=  Pulse(Total  Demand  Start,  Total  Demand  Duration) 
"Attractiveness#!  Change  Amount'-  0 

Making  Available=  Allocating  Interest  Income+Borrowing+Earnings+Funding 

from  VC+Unused  Funds 

Max  Inventory  Use=  20 

Max  Inventory  Use  2=  10 

"Step  for  Attractiveness#! "=  Pulse(" Attractiveness#!  Start", 

"Attractiveness#  1  Duration") 

Initial  Demand=  30 

Total  Demand  Duration=  0 

Inventory  Use  3=Min(Max  Inventory  Use  3, (Preference  for  Supply  Chain  3*Total 
Demand)) 

"Attractiveness#!  Change"=  "Step  for  Attractiveness#!"*" Attractiveness#!  Change 
Amount" 

"Attractiveness#!  Start"=  0 

"Attractiveness#  lDuration"=  0 

Inventory  Gap  1=  Max  Inventory  Use-Inventory  Use 

Total  Demand=  Initial  Demand*  (1+Total  Demand  Change) 

Inventory  Use  2=Min(Max  Inventory  Use  2, (Preference  for  Supply  Chain  2*Total 
Demand)) 

Total  Demand  Amount=  0 

Total  Demand  Start=  0 

Supply  Chain  Attractiveness  1=  "EffectOlDeliveryDelayOnAttractiveness#!"  * 
"EffectOfPriceOnAttractiveness#  1 "  *  ( 1 +"  Attractiveness#  1  Change") 

Inventory  Use= 

Min(Max  Inventory  Use,(Preference  for  Supply  Chain 

1*  Total  Demand)) 

Unused  Funds=  0 

Fraction  of  Max  f  0([(0,0)- 

(1.5,2),(0,0),(2,2)],(0,0),(0.5,0.5),(0.621176,0.604982),(0.72,0.683274),(0.818824\ 
,0.768683),(0.921176,0.846975),(1,0.911032),(1.11176,0.975089),(1.2,1),(1.5,1)) 
Desired  draining=  Desired  Capital  Usage 

fractionOfMaxOutflow  0=  Fraction  of  Max  f  0(IndicatedFractionOfMax  0) 

Fastest  draining  time  0  =  0.5 

Maximum  outflow  0=  Available  Capital/  Fastest  draining  time  0 

Actual  Capital  Usage=  fractionOfMaxOutflow  0*Maximum  outflow  0 
IndicatedFractionOfMax  0=  xidz(Desired  draining,Maximum  outflow  0,10) 

Spending  Gap=  Desired  Capital  Usage-Actual  Capital  Usage 

Capital  Reduction  Start  0=  0 

Step  for  Spending  Change=  Pulse(Capital  Reduction  Start  0,  Spending  Change 
Duration) 

Spending  Change  Duration=  0 
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Spending  Change  Amount=  0 

Spending  Change=  Step  for  Spending  Change* Spending  Change  Amount 

Desired  Capital  Usage=  1 .2e+006*(l+Spending  Change) 

Capital  draining=  Capital  Aeeess  Reduetion 

IndieatedFraetionOfIVIax=  xidz(Capital  draining, Maximum  outflow,  10) 

Dmnl 

fractionOfMaxOutflow=  Fraction  of  Max  f(IndicatedFractionOfMax) 

Fastest  draining  time  =  0.5 

Maximum  outflow=  Available  Capital/  Fastest  draining  time 

Fraction  of  Max  f([(0,0)-(1.5,2),(0,0),(2,2)],(0,0),(0.5,0.5),(0.621 176,0.604982), 
(0.72,0.683274),(0.818824,0.768683),(0.921 176,0.846975),(1,0.91 1032),(1.1 1 176,0.9750 
89),(1.2,1),(1.5,1)) 

Capital  Access  Reduction  Rate=  fractionOfMaxOutflow*Maximum  outflow 
Action  to  Make  Capital  Available=  Capital  Gap/Time  to  Close  Capital  Gap 
Desired  Capital=  4.8e+006 

Time  to  Close  Capital  Gap=  12 

Capital  Gap=  Desired  Capital-Available  Capital 

Step  for  Capital  Reduction=  Pulse(Capital  Reduction  Start,  Capital  Reduction  Duration) 
Capital  Access  Reduction=  Step  for  Capital  Reduction* Capital  Reduction 
Amount*Initial  Available  Capital 
Capital  Reduction  Amount=  0 

Available  Capital=  INTEG  (  Making  Available-Capital  Access  Reduction  Rate- Actual 
Capital  Usage,  Initial  Available  Capital) 

Capital  Reduction  Start=  0 

Capital  Reduction  Duration=  0 
Initial  Available  Capital=  4.8e+006 

Funding  from  VC=  VC  funding  Rate+ Action  to  Make  Capital  Available 

Workforce  Reduction=  Workforce*Step  for  Workforce  Reduction*Reduction 

Amount 

Reduction  Start=  0 

Desired  Workforce=  Initial  Workforce 

Initial  Hiring=  20 

Reduction  Amount=  0 

time  to  adjust  workforce=  52 

hiring=  Workforce  Adjustment+Initial  Hiring 

Step  for  Workforce  Reduction=  Pulse(Reduction  Start,  Reduction  Duration) 
attrition=  Initial  Attrition+Workforce  Reduction 

Reduction  Duration=  0 

Workforce  Gap=  Desired  Workforce- Workforce 

Workforce  Adjustment=  Workforce  Gap/time  to  adjust  workforce 

VC  funding  Rate=  300000 

Borrowing  Rate=  300000 

Earnings=  300000 

Available  Credit=  INTEG  (-Borrowing,  Ie+008) 

Borrowing=  Borrowing  Rate 

Allocating  Interest  Income=  Interest  Income 


38 


Cash  Reserves=  INTEG  (  Interest  Income- Alloeating  Interest  Income, 

Interest  Income=  Cash  Reserves*Interest  Rate 

Available  VC=  INTEG  (-Eunding  from  VC,  le+009) 

Total  Capital  Resource=  Equipment+Eacilities 

Interest  Rate=  0.03 

Add'l  experience  from  new  hires  =  average  experience  of  new  hire  *  hiring 
Add'l  quality  from  new  equipment  =  average  quality  of  new  equipment  *  Equipping 
Add'l  quality  from  new  faciliites  =  average  experience  of  new  facilities  *  Building 

Eacility  Eoss  =  Eacilities  /  Time  for  Eacilities  to  Erode 
Building=  1800 

Time  for  Eacilities  to  Erode  =10 
Initial  Workforce=  INITIAL(  200) 

Initial  Attrition=  20 

average  equipment  quality  =  Total  Equipment  Quality  /  Equipment 
average  experience  =  Total  experience  /  Workforce 
average  experience  of  new  facilities  =  2 
average  experience  of  new  hire  =  2 

average  facility  quality  =  Total  Eacilitiy  Quality  /  Eacilities 
Eacilities  =  INTEG(Building  -  Eacility  Eoss,  Initial  Eacilities) 
facility  quality  loss  =  Eacility  Eoss  *  average  facility  quality 
gaining  experience  =  Workforce  *  rate  of  experience  gain 
gaining  quality  =  Eacilities  *  rate  of  facility  quality  change 
gaining  quality  0  =  Equipment  *  rate  of  equipment  quality  change 
average  quality  of  new  equipment  =  2 

Initial  Eacilities  =  INITIAL(  Building  *  Time  for  Eacilities  to  Erode) 

rate  of  equipment  quality  change  =  1 

rate  of  experience  gain  =  1 

rate  of  facility  quality  change  =  1 

Total  Equipment  Quality  =  INTEG( 

Add'l  quality  from  new  equipment  +  gaining  quality  0  -  equipment  quality  loss. 
Equipment  *  (average  quality  of  new  equipment  + 

rate  of  equipment  quality  change  *  Equipment  /  Equipment  Eoss\ 

)) 

Total  experience=  INTEG  (  Add'l  experience  from  new  hires  +  gaining  experience  - 
experience  loss,  100) 

Time  for  Equipment  to  Erode  =10 

equipment  quality  loss  =  Equipment  Eoss  *  average  equipment  quality 
Equipping=  1800 

experience  loss  =  attrition  *  average  experience 
Workforce  =  INTEG(hiring  -  attrition.  Initial  Workforce) 

Total  Eacilitiy  Quality  =  INTEG( 

Add'l  quality  from  new  faciliites  +  gaining  quality  -  facility  quality  loss, 

Eacilities  *  (average  experience  of  new  facilities  + 

rate  of  facility  quality  change  *  Eacilities  /  Eacility  Eoss\ 

)) 
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Initial  Equipment  =  INITIAL(  Equipping  *  Time  for  Equipment  to  Erode) 

Equipment  Eoss  =  Equipment  /  Time  for  Equipment  to  Erode 
Equipment  =  INTEG(Equipping  -  Equipment  Eoss,  Initial  Equipment) 

Target  Inventory  on  Order  3= 

Ordering  Multiplier  2=  1 

Ordering  Multiplier  3=  1 

Adjusting  Inventory  2=  Total  Inventory  Gap  2  /  Target  Time  to  Adjust  Inventory  2 

Adjusting  Inventory  3=  Total  Inventory  Gap  3  /  Target  Time  to  Adjust  Inventory  3 

Ordering  Quality  l=Ordering  3*Quality  of  New  Inventory  1 

Average  Quaility  in  Inventory  0=  Total  Quality  of  Current  Eab  Inventory  0/Current 
Eab  Inventory  2 

Average  Quaility  in  Inventory  1=  Total  Quality  of  Current  Eab  Inventory  1 /Current 
Eab  Inventory  3 

Initial  Inventory  Quality  1=  INITIAL(  Current  Eab  Inventory  3*Quality  of  New 
Inventory  1) 

Average  Quality  in  Proeess  0=  Total  Quality  of  Inventory  in  Proeess  0/Eab 
Inventory  In  Proeess  2 

Average  Quality  in  Proeess  1=  Total  Quality  of  Inventory  in  Proeess  1/Eab 
Inventory  In  Proeess  3 

Initial  Quality  in  Proeess  1=  INITIAL(  Quality  of  New  Inventory  l*Eab  Inventory 
In  Proeess  3) 

Quality  Change  from  Use  0=  Average  Quaility  in  Inventory  0*lnventory  Use  2 

Awareness  Of  Eab  Inventory  in  Proeess  2  =  1 

Awareness  Of  Eab  Inventory  in  Proeess  3  =  1 

Target  Inventory  on  Order  2=  Inventory  Use  2  *  Proeurement  Time  2 

ReplacingCapacity  2  =  Inventory  Use  2 

Current  Inventory  Gap  2=  Desired  Inventory  2-Current  Eab  Inventory  2 

Current  Inventory  Gap  3=  Desired  Inventory  3-Current  Eab  Inventory  3 

Proeurement  Time  3  =  3 

Target  Time  to  Adjust  Inventory  2=  12 

Target  Time  to  Adjust  Inventory  3=  12 

Current  Eab  Inventory  2  =  INTEG(  Procuring  2  -  Inventory  Use  2  ,  Desired  Inventory  2  \ 
Current  Eab  Inventory  3  =  INTEG(  Procuring  3  -  Inventory  Use  3  ,  Desired  Inventory  3  ) 
Procuring  3  =  Eab  Inventory  In  Process  3  /  Procurement  Time  3 

Perceived  Inventory  in  Process  2=  Lab  Inventory  In  Process  Gap  2*  Awareness  Of  Lab 
Inventory  in  Process  2 

Quaility  Change  from  Procuring  0=  Average  Quality  in  Process  0*Procuring  2 
Quaility  Change  from  Procuring  1=  Average  Quality  in  Process  l*Procuring  3 
Lab  Inventory  In  Process  3  =  INTEG(  Ordering  3  -  Procuring  3  ,  Target  Inventory  on 
Order  3\) 

Total  Quality  of  Current  Lab  Inventory  0=  INTEG  ( Quaility  Change  from  Procuring  0- 
Quality  Change  from  Use  0,  Initial  Inventory  Quality  0) 

Desired  Inventory  2=  90 

Desired  Inventory  3=  90 

Quality  of  New  Inventory  0=  10 
Quality  of  New  Inventory  1=  10 
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Ordering  Quality  0=  Ordering  2*Quality  of  New  Inventory  0 

Initial  Quality  in  Proeess  0=  INITIAL(  Quality  of  New  Inventory  0*Lab  Inventory 

In  Process  2) 

Lab  Inventory  In  Process  2  =  INTEG(  Ordering  2  -  Procuring  2  ,  Target  Inventory  on 
Order  2) 

Initial  Inventory  Quality  0=  INITIAL(  Current  Lab  Inventory  2*Quality  of  New 
Inventory  0)  | 

Lab  Inventory  In  Process  Gap  3=  Target  Inventory  on  Order  3-Lab  Inventory  In 
Process  3 

Ordering  2=(Adjusting  Inventory  2  +  ReplacingCapacity  2)*Ordering  Multiplier  2 
Total  Inventory  Gap  3=  Perceived  Inventory  in  Process  3+Current  Inventory  Gap  3 
Total  Quality  of  Inventory  in  Process  0=  INTEG  (  Ordering  Quality  0-Quaility  Change 
from  Procuring  0,  Initial  Quality  in  Process  0) 

Total  Quality  of  Inventory  in  Process  1=  INTEG  (  Ordering  Quality  1-Quaility  Change 
from  Procuring  1,  Initial  Quality  in  Process  1) 

Total  Inventory  Gap  2=  Perceived  Inventory  in  Process  2-l-Current  Inventory  Gap  2 
Procurement  Time  2  =  3 

Eab  Inventory  In  Process  Gap  2=  Target  Inventory  on  Order  2-Eab  Inventory  In 
Process  2 

Quality  Change  from  Use  1=  Average  Quaility  in  Inventory  I*Inventory  Use  3 
Perceived  Inventory  in  Process  3=  Eab  Inventory  In  Process  Gap  3*  Awareness  Of  Eab 
Inventory  in  Process  3 

Ordering  3=(Adjusting  Inventory  3  +  ReplacingCapacity  3)*Ordering  Multiplier  3 
Total  Quality  of  Current  Eab  Inventory  1=  INTEG  ( Quaility  Change  from  Procuring  1- 
Quality  Change  from  Use  1,  Initial  Inventory  Quality  1) 

Procuring  2  =  Eab  Inventory  In  Process  2  /  Procurement  Time  2 
ReplacingCapacity  3  =  Inventory  Use  3 
Ordering  Multiplier  0=  1 

Initial  Inventory  Quality=  INITIAL(  Current  Eab  Inventory*  Quality  of  New  Inventory) 
Adjusting  Inventory  0=  Total  Inventory  Gap  0  /  Target  Time  to  Adjust  Inventory  0 

Adjusting  Inventory  1=  Total  Inventory  Gap  I  /  Target  Time  to  Adjust  Inventory  I 

Average  Quaility  in  Inventory=  Total  Quality  of  Current  Lab  Inventory/Current  Lab 
Inventory 

Average  Quality  in  Process=  Total  Quality  of  Inventory  in  Process/Lab  Inventory  In 
Process  | 

Perceived  Inventory  in  Process  1=  Lab  Inventory  In  Process  Gap  I*Awareness  Of  Lab 
Inventory  in  Process  I 

Awareness  Of  Lab  Inventory  in  Process  0  =  1 
Awareness  Of  Lab  Inventory  in  Process  I  =  I 

Preference  for  Supply  Chain  3  =  Supply  Chain  Attractiveness  3  /  TotalAttractiveness 
Current  Inventory  Gap  0=  Desired  Inventory  0-Current  Lab  Inventory  0 
Current  Inventory  Gap  1=  Desired  Inventory  I -Current  Lab  Inventory  I 
"Price#3"=  10 

Current  Lab  Inventory  0  =  INTEG(  Procuring  0  -  Inventory  Use  0  ,  Desired  Inventory  0  \ 
Current  Lab  Inventory  I  =  INTEG(  Procuring  I  -  Inventory  Use  I  ,  Desired  Inventory  I  \ 
"DeliveryDelay#I"=  10 
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"DeliveryDelay#2"=  10 

"DeliveryDelay#3"=  10 

Procuring  1  =  Lab  Inventory  In  Process  1  /  Procurement  Time  1 
Desired  Inventory  0=  90 

Desired  Inventory  1=  90 

EffectOfDeliveryDelayOnAttractiveness  f  ( [(0.5,0)- 

(1,1)], (0.5, 0.01), (0.561856, 0.0263158\), (0.631443, 0.0690789), (0.681701, 0.131579), (0.7 
25515,0.259868),(0.780928,0.634868),\(0.824742,0.828947),(0.880155,0.934211),(0.917 
526,0.973684),(0.962629,0.983553),(1,\  1) ) 

"EffectOfDeliveryDelayOnAttractiveness#! "  =  EffectOfDeliveryDelayOnAttractiveness 
f  (\  "RelativeDeliveryDelay#!"  ) 

"EffectOfDeliveryDelayOnAttractiveness#2"  =  EffectOfDeliveryDelayOnAttractiveness 
f  ("RelativeDeliveryDelay#2"  ) 

"EffectOfDeliveryDelayOnAttractiveness#3  "  =  EffectOfDeliveryDelayOnAttractiveness 
f  (  "RelativeDeliveryDelay#3"  ) 

EffectOfPriceOnAttractiveness  f  ( 
(1,0)(2,1)],(1,1),(1.20103,0.911184),(1.33505,0.769737), 

(1. 44845,0.430921),(1. 63402,0. 141447),(1.78608,0.0690789),(2,0.05)) 
"EffectOfPriceOnAttractiveness#!"  =  EffectOfPriceOnAttractiveness  f  ( 
"RelativePrice#!" ) 

"EffectOfPriceOnAttractiveness#2"  =  EffectOfPriceOnAttractiveness  f  ( 
"RelativePrice#2"  ) 

"EffectOfPriceOnAttractiveness#3"  =  EffectOfPriceOnAttractiveness  f  ( 
"RelativePrice#3") 

Initial  Quality  in  Process=  INITIAL(  Quality  of  New  Inventory*Eab  Inventory  In 
Process) 

ReplacingCapacity  0  =  Inventory  Use  0 
Inventory  Use  0=  10 

Inventory  Use  1=  10 

Supply  Chain  Attractiveness  2  =  "EffectOfDeliveryDelayOnAttractiveness#2"  * 
"EffectOfPriceOnAttractiveness#2" 

Eab  Inventory  In  Process  0  =  INTEG(  Ordering  0  -  Procuring  0  ,  Target  Inventory  on 
Order  0) 

Lab  Inventory  In  Process  1  =  INTEG(  Ordering  1  -  Procuring  1  ,  Target  Inventory  on 
Order  1) 

Target  Inventory  on  Order  0=  Inventory  Use  0  *  Procurement  Time  0 

Lab  Inventory  In  Process  Gap  0=  Target  Inventory  on  Order  0-Lab  Inventory  In 

Process  0 

Lab  Inventory  In  Process  Gap  1=  Target  Inventory  on  Order  1-Lab  Inventory  In 
Process  1 

normalDeliveryDelay=  10 

NormalPrice=  10 

Quaility  Change  from  Procuring=  Average  Quality  in  Process*Procuring 
Ordering  0=  (Adjusting  Inventory  0  +  ReplacingCapacity  0)*Ordering 

Multiplier  0 
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Ordering  1=  (Adjusting  Inventory  1  +  ReplaeingCapaeity  l)*Ordering 

Multiplier  1 

TotalAttraetiveness  =  Supply  Chain  Attractiveness  1  +  Supply  Chain  Attractiveness  2  +\ 
Supply  Chain  Attractiveness  3 
Quality  of  New  Inventory=  10 

Ordering  Multiplier  1=  1 

Ordering  Quality=  Ordering*  Quality  of  New  Inventory 

"RelativeDeliveryDelay#3"  =  normalDeliveryDelay  /  "DeliveryDelay#3" 

Perceived  Inventory  in  Process  0=  Lab  Inventory  In  Process  Gap  0*Awareness  Of  Lab 
Inventory  in  Process  0 

"RelativePrice#2"  =  "Price#2"  /  NormalPrice 

Preference  for  Supply  Chain  1  =  Supply  Chain  Attractiveness  1  /  TotalAttraetiveness 
Preference  for  Supply  Chain  2  =  Supply  Chain  Attractiveness  2  /  TotalAttraetiveness 
Quality  Change  from  Use=  Average  Quaility  in  Inventory* Inventory  Use 
"Price#  1"=  10 

"Price#2"=  10 

Procuring  0  =  Lab  Inventory  In  Process  0  /  Procurement  Time  0 

Supply  Chain  Attractiveness  3  =  "EffectOfDeliveryDelayOnAttractiveness#3"  * 

"EffectOfPriceOnAttractiveness#3" 

Procurement  Time  0  =  3 
Procurement  Time  1  =  3 

Target  Inventory  on  Order  1= Inventory  Use  1  *  Procurement  Time  1 

Total  Quality  of  Inventory  in  Process=  INTEG  (Ordering  Quality-Quaility  Change  from 

Procuring,  Initial  Quality  in  Process) 

Target  Time  to  Adjust  Inventory  0=  12 
Target  Time  to  Adjust  Inventory  1=  12 

"RelativeDeliveryDelay#2"  =  "DeliveryDelay#2"  /  normalDeliveryDelay 
Total  Quality  of  Current  Eab  Inventory=  INTEG  (  Quaility  Change  from  Procuring- 
Quality  Change  from  Use,  Initial  Inventory  Quality)  | 

"RelativePrice#!"  =  "Price#l"  /  NormalPrice 

"RelativeDeliveryDelay#!"  =  "DeliveryDelay#!"  /  normalDeliveryDelay 
ReplaeingCapaeity  1  =  Inventory  Use  1 

Total  Inventory  Gap  0=  Perceived  Inventory  in  Process  0+Current  Inventory  Gap  0 
"RelativePrice#3"  =  "Price#3"  /  NormalPrice 

Total  Inventory  Gap  1=  Perceived  Inventory  in  Process  1+Current  Inventory  Gap  1 
Ordering=  (Adjusting  Inventory  +  ReplaeingCapaeity)* Ordering 

Multiplier 

Ordering  Multiplier=  1 

Desired  Inventory=  90 

Adjusting  Inventory=  Total  Inventory  Gap  /  Target  Time  to  Adjust  Inventory 

Awareness  Of  Eab  Inventory  in  Process  =  1 

Current  Inventory  Gap=  Desired  Inventory-Current  Eab  Inventory 

Current  Eab  Inventory  =  INTEG(  Procuring  -  Inventory  Use  ,  Desired  Inventory  ) 

Eab  Inventory  In  Process  =  INTEG(  Ordering  -  Procuring  ,  Target  Inventory  on  Order  ) 
Eab  Inventory  In  Process  Gap=  Target  Inventory  on  Order-Eab  Inventory  In  Process 
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Perceived  Inventory  in  Process=Lab  Inventory  In  Process  Gap*  Awareness  Of  Lab 
Inventory  in  Process 
Procurement  Time  =  3 

Procuring  =  Lab  Inventory  In  Process  /  Procurement  Time 
ReplacingCapacity  =  Inventory  Use 

Target  Inventory  on  Order=  Inventory  Use  *  Procurement  Time 
Target  Time  to  Adjust  Inventory=  12 

Total  Inventory  Gap=Perceived  Inventory  in  Process+Current  Inventory  Gap 
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